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REMARKS 

Applicant respectfully requests reconsideration and allowance of the subject 
application. Claims 1-20 are pending. 
35 V.S.C. $102 

Claims 1, 9, and 16 are rejected under 35 U.S.C. §102 as being anticipated 
by U.S. Patent No. 5,822,537 to Katseff et al (Katseff). Applicants respectfully 
traverse the rejection. 

The claimed invention is directed to synchronizing asynchronous time- 
based and motion data by retrieving from a server frames of data that make up a 
time-based data stream and a motion data stream, variably buffering one of the two 
streams, and producing two streams with synchronized frames. The two streams 
with synchronized firames are played at a client, producing synchronized motion 
and time-based data. (See Specification, Page 2, lines 1-12). Synchronization of 
the data frames (data streams) takes place at a synchronizer prior to transmitting 
the synchronized data streams to a network, eliminating the need for the client to 
synchronize the data streams. (See Specification, page 9, lines 3-6 and Fig. 4) 

Amended Claim 1, for example, recites a method of synchronizing 
asynchronous time-based and motion data in a system in which the time- 
based data and motion data are transmitted by a server over a network to a 
client, the method comprising: 

retrieving a time-based data stream and a motion data stream at the 
server, each stream comprising frames of data; 

variably buffering one of the time-based data stream and the motion 
stream to produce two streams having synchronized frames; and 



leeOhayes pte so9*a24>g2S6 



9 



1 127021034 G:\MSI'I\1095uscI\MSJ'I09SUSClM0I verS.doe 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 



% 



using the synchronized frames at the client for playback of 
synchronized motion and time-based data to a user. 

The method of claim 1 is not disclosed by Katseff. Katseff shows a 
multimedia system to record, store and distribute multimedia presentations 
together with materials that may be referenced during the presentation (see 
Abstract of Katseff). Katseff shows a continuous media and storage retrieval 
system used for digitizing and compressing audio, video, and other continuous data 
(Katseff at col. 5 lines 18-22). Katseff shows a digitizer/compressor that generates 
a data stream that preferably is in JPEG file format. JPEG file format is preferred 
because of the inherent synchronization of audio and video streams (Katseff at col. 
6, lines 60-67 through col. 7, lines 1-7). Katseff further shows an information 
retrieval system that allows a user to access multimedia information that has been 
stored in a pluraUty of databases (Katseff at col. 8, lines 18-22). Katseff does not 
disclose accessing of separate audio (time-based) and video (motion-based). 

In Katseff, a workstation (client) retrieves several frames of audio and 
video from a file server for storage in an audio buffer and a video buffer. No 
synchronization is made as to the audio and video frames. Katseff discloses that it 
is preferred that the workstation will have a mechanism to synchronize the 
presentation of the various outputs (audio and video) (Katseff at col. 8, lines 60-65 
through col. 9, lines 1-5). Katseff does not disclose that audio and video frames be 
synchronized prior to receipt at the workstation. 

Claim 1 in part recites "retrieving a time-based data stream and a motion 
data stream at the server, each stream comprising frames of data." Katseff does 
not show this aspect. Katseff describes retrieving single data streams and fails to 
disclose retrieving separate time-based data and motion data streams. The JPEG 
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file format is particularly pointed out by Katseff, in that JPEG file format provides 
a single data stream of inherently synchronized audio and video streams. 

Claim 1 in part recites "variably buffering one of the time-based data stream 
and the motion stream to produce two streams having synchronized frames." 
Katseff does not show this aspect. Katseff discloses that audio and video frames 
are placed in buffers; however Katseff is silent as to synchronizing such audio and 
video frames at any point. Katseff relies on a mechanism at the workstation to be 
able to synchronize audio and video frames. The subject application avoids the 
need for the client to synchronize time-based and motion-based data by 
synchronizing time-based and motion-based data with one another prior to 
transmitting to a client. 

Claim 1 in part recites "using the synchronized frames at the client for 
playback of synchronized motion and time-based data to a user." Katseff does not 
show this aspect. Katseff describes a workstation receiving audio and video 
frames that are not synchronized. Katseff relies on a mechanism at the workstation 
(client) to synchronize the audio and video frames. Katseff does not teach nor 
disclose that audio and video frames are synchronized prior to receipt by the 
workstation (client). 

For these reasons, claim 1 is patentable over Katseff. Applicants 
respectfully request that the §102 rejection of claim 1 be withdrawn. 

Dependent claim 9 is allowable by virtue of its dependency on base claim 
1. For the reasons given above with respect to claim 1, the systems and methods 
recited in claim 9 are neither disclosed nor taught by Katseff. Applicants 
respectfully request that the §102 rejection of claim 9 be withdrawn. 
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Claim 16 recites an apparatus for synchronizing asynchronous time-based 
and motion data in a system in which the time-based data and the motion 
data are transmitted by a server over a network to a client, the apparatus 
comprising: 

a data retriever for retrieving a time-based data stream and a motion 
data stream at the server, each of the streams comprising frames of data; 

a data stream synchronizer for buffering one of the time-based data 
stream and the motion stream to produce two streams having synchronized 
frames; and 

a packetizer for packaging synchronized frames of motion data and 
time-based data for use at the cUent for playback of synchronized motion 
and time-based data to a user. 

As discussed above, Katseff does not disclose accessing of separate audio 
(time-based) and video (motion-based). Katseff shows a workstation (client) that 
retrieves several frames of audio and video from a file server for storage in an 
audio buffer and a video buffer. No synchronization is made as to the audio and 
video frames. Katseff suggests that the workstation have a mechanism that 
synchronizes the presentation of the various outputs (audio and video) (Katseff at 
col. 8, lines 60-65 through col. 9, lines 1-5). Katseff does not disclose that audio 
and video frames be synchronized prior to receipt at the workstation. Katseff 
further describes that audio and video frames be buffered at the workstation and 
that the workstation include a mechanism for synchronization of audio and video 
frames for playback. 

Claim 16 in part recites "a data stream synchronizer for buffering one of the 
time-based data stream and the motion stream to produce two streams having 
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synchronized frames.*' Katseff does not show this aspect. As discussed, Katseff 
discloses buffering audio and video frames; however, Katseff does not disclose 
that the frames are synchronized with one another by buffering one of the time- 
based and motion stream. Further Katseff does not disclose that two streams 
having synchronized frames are produced from the buffering. 

Claim 16 in part recites "a packetizer for packaging synchronized frames of 
motion data and time-based data for use at the client for playback of synchronized 
motion and time-based data to a user." Katseff does not show this aspect. As 
discussed above, Katseff does not disclose sjoichronized frames of motion and 
time-based data. Therefore, Katseff would have no need to package such 
"synchronize frames.'' 

For these reasons, claim 16 is patentable over Katseff. Applicants 
respectfully request that the §102 rejection of claim 16 be withdrawn. 

35 V.S.C. S103 

Claims 2. 4. 12. 14, and 18 

Claims 2, 4, 12, 14, and 18 are rejected under 35 U.S.C. §103 as being 
unpatentable over Katseff in view of Shibata, Y., Media Synchronization Protocols 
for Packet Audio- Video Systems on Multimedia Information Networks (Shibata), 
IEEE, January 3-6, 1995. Applicant respectfiiUy traverses the rejection. 

Claims 2, 4, and 12 depend from claim 1 and hence incorporate the 
features of claim 1. As such claims 2, 4, and 12 require "...retrieving a time-based 
data stream and a motion data stream at the server, each stream comprising frames 
of data; variably buffering one of the time-based data stream and the motion 
stream to produce two streams having synchronized frames; and using the 
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synchronized frames at the dient for playback of synchronized motion and time- 
based data to a user." 

Katseff does not suggest nor teach retrieving both a time-based data stream 
and motion data stream. Katseff shows retrieving single data streams such as a 
JPEG data stream (Katseff col. 6, lines 60-65). Katseff does not suggest nor teach 
synchronizing frames of the time-based data stream and the motion data stream to 
produce two streams of synchronized frames, by buffering one of the data streams. 
Katseff discloses buffering, however, the buffering of audio and video frames does 
not produce synchronized frames (Katseff at col. 8, lines 60-65). Katseff relies on 
a mechanism at the workstation to synchronize audio and video frames (Katseff at 
col. 9, lines 1-5). The workstation (client) therefore never receives synchronized 
frames for playback. The workstation is required to synchronized the frames with 
a built-in synchronizing mechanism. Katseff does not suggest nor teach "using the 
synchronized frames at the client for playback of synchronized motion and time- 
based data to a user." 

Examiner points out that Shibata teaches a rate control message that is sent 
to a server. The rate controller described on page 596 of Shibata does not suggest 
that data streams be variably buffered. Shibata' s rate controller monitors a current 
video frame rate with a set video frame rate value and adjusts the video frame rate 
depending on the difference between the set video frame rate value and the current 
video firame rate value. Further Shibata does not suggest that audio or time-based 
rate values can be controlled. Shibata states that "since the audio segment rate is, 
relatively, much smaller than that of the video, audio segments do not require rate 
control . . . [T]herefore, only the video frame rate is controlled. (Shibata at page 
596). 
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Shibata provides no assistance in light of Katseff as to the recited 
methodology of claim 2. Accordingly, a combination of Katseff and Shibata fails 
to teach or suggest the claimed methods. Applicants respectfully request that the 
§103 rejection of claims 2 be withdrawn. 

Claim 4 further adds "transferring only those data values for a frame that 
have changed since a last frame was transmitted." Frames are synchronized prior 
to transferring of data values. In other words, a time-based frame is synchronized 
with a motion frame; time based and motion based frames are sent with one 
another. If no change occurs, the frames are not transmitted, Shibata discloses 
displaying (receiving) video frames while silence (no audio) takes place. (Shibata 
at page 597). Shibata describes that synchronization of audio and video takes 
place at the display (client). 

Shibata is cited for its teaching of a method whereby audio data is sent from 
the video server to the client station only during a "talk spurt." Shibata provides 
no assistance in light of Katseff as to the recited methodology of claim 4. Both 
Katseff and Shibata suggest and teach that audio and video synchronization takes 
place at the client, teaching against synchronization of frames prior to receipt by 
the client. Accordingly, a combination of Katseff and Shibata fails to teach or 
suggest the claimed methods. Applicants respectfully request that the §103 
rejections of claims 4 be withdrawn. 

Shibata is cited for its teaching of a rate control message that is sent to a 
server. Shibata provides no assistance in light of Katseff as to the recited 
methodology of claim 12. Accordingly, a combination of Katseff and Shibata fails 
to teach or suggest the claimed methods. Applicants respectfully request that the 
§103 rejection of claim 12 be withdrawn. 
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Claim 14 in part recites "...packaging synchronized frames of data where 
each frame includes one or more channels of data in a system in which 
synchronized frames are transmitted by a server over a network to a client, the 
method comprising: storing a last data value for each channel in each frame 
transmitted over the network; ...and packaging and transmitting over the network 
only data for channels having changed data values. 

Further claim 14 provides for storing a last data value and transmitting data 
only when data values have changed. Examiner points out that "Shibata teaches a 
method .whereby a rate controller periodically monitors and stores in RAM a 
current frame rate, a number computed by frames/second." Claim 14 is concerned 
with a present (last) data value, storing the present (last) data value, and comparing 
the stored present (last) data value to a subsequent data value. If there is a 
difference in stored and subsequent data values, then the subsequent data value is 
transmitted. As Examiner has pointed out, Shibata looks at a rate change, in 
particular a video rate change. As discussed above, current video rate is compared 
to a predetermined rate (that does not change), and current video rate is adjusted 
according to the difference. The rate control described in Shibata does not suggest 
that values can be compared, and that the value (stored present data value) for 
which subsequent data values are compared against can change. 

Therefore, Shibata provides no assistance in light of Katseff as to the 
recited methodology of claim 14. Accordingly, a combination of Katseff and 
Shibata fails to teach or suggest the claimed methods. Applicants respectfully 
request that the §103 rejection of claims 14 be withdrawn. 

Claim 18 depends from claim 16 and hence incorporates the features of 
claim 16. As such claim 18 requires "a data retriever for retrieving a time-based 
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data stream and a motion data stream at the server, each of the streams comprising 
frames of data; a data stream synchronizer for buffering one of the time-based data 
stream and the motion stream to produce two streams having synchronized frames; 
and a packetizer for packaging synchronized frames of motion data and time-based 
data for use at the client for playback of synchronized motion and time-based data 
to a user." 

Katseff does not suggest nor teach retrieving both a time-based data stream 
and motion stream. Katseff does not suggest nor teach synchronizing frames of 
the time-based data stream and the motion stream to produce two streams of 
synchronized frames, by buffering one of the data streams. Katseff discloses 
buffering, however, the buffering of audio and video frames does not produce 
synchronized frames (Katseff at col, 8, lines 60-65). Katseff relies on a 
mechanism at the workstation to synchronize audio and video frames (Katseff at 
col. 9, lines 1-5). Katseff is silent as to packaging synchronized audio and video 
frames, in light of the fact that there are not synchronized frames to be packaged in 
Katseff 

The Examiner presents the same arguments in rejecting claim 18, as those 
presented in rejecting claim 14. Applicants assert the arguments in support of 
claim 14. Further, the Examiner states that it would have been obvious to one of 
ordinary skill in the art to modify Katseff to incorporate a storage device to hold 
data values referring to Katseff. 

Shibata provides no assistance in light of Katseff as to the recited 
methodology of claim 18. Accordingly, a combination of Katseff and Shibata fails 
to teach or suggest the claimed methods. Applicants respectfully request that the 
§103 rejection of claim 18 be withdrawn. 
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Claim 3 

Claim 3 is rejected under 35 U.S.C. §103 as being unpatentable over 
Katseff as applied to claim 1, and in view of U.S. Patent No. 5,642,171 to 
Baumgartner et al (Baumgartner). 

Claim 3 depends from claim 1 and hence incorporates the features of claim 
L As such claim 3 requires "...retrieving a time-based data stream and a motion 
data stream at the server, each stream comprising frames of data; variably 
buffering one of the time-based data stream and the motion stream to produce two 
streams having synchronized frames; and using the synchronized frames at the 
client for playback of synchronized motion and time-based data to a user." 

Applicants present the arguments in support of claims 2, 4, 12, and 14 in 
regards to Katseff. 

Baumgartner is cited for its teaching of a method whereby a current video 
frame number is subtracted from a current audio frame number. Baumgartner; 
however, provides no assistance in light of Katseff as to the recited methodology 
of claim 3. Accordingly, a combination of Katseff and Shibata fails to teach or 
suggest the claimed methods. Applicants respectfiiUy request that the §103 
rejection of claim 3 be withdrawn. 

Claim 5 and 13 

Claims 5 and 13 are rejected under 35 U.S.C. §103 as being unpatentable 
over Katseff as applied to claim 1 . 

Claims 5 and 13 depend from claim 1 and hence incorporate the features of 
claim 1. As such claims 5 and 13 require "...retrieving a time-based data stream 
and a motion data stream at the server, each stream comprising frames of data; 
variably buffering one of the time-based data stream and the motion stream to 
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produce two streams having synchronized frames; and using the synchronized 
frames at the chent for playback of synchronized motion and time-based data to a 
user." 

AppUcants present the arguments in support of claims 2, 4, 12, and 14 in 
regards to Katseff. 

Accordingly, Katseff fails to teach or suggest the claimed methods. 
Applicants respectfully request that the §103 rejections of claims 5 and 13 be 
withdrawn. 

Claims 6. 7. 10. 17. and 19 

Claims 6, 7, 10, 17, and 19 are rejected under 35 U.S.C. §103 as being 
unpatentable over Katseff as applied to claims 1 and 16, and in further view of 
U.S. Patent No. 9,950,202 to Durward et al (Durward). 

Claims 6, 7, and 10 depend from claim 1 and hence incorporate the 
features of claim 1 . As such claims 6, 7, and 10 require . .retrieving a time-based 
data stream and a motion data stream at the server, each stream comprising frames 
of data; variably buffering one of the time-based data stream and the motion 
stream to produce two streams having synchronized frames; and using the 
synchronized frames at the client for playback of synchronized motion and time- 
based data to a user." 

Applicants present the arguments in support of claims 2, 4, 12, and 14 in 
regards to Katseff. 

Durward is cited for its teaching of a method whereby updated positional 
data from a person's head position sensor is mapped and used to determine the 
position of a virtual being defined fro that user. Durward; however, provides no 
assistance in light of Katseff as to the recited methodology of claims 6, 7 and 10. 
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Accordingly, a combination of Katseff and Shibata fails to teach or suggest the 
claimed methods. Applicants respectfully request that the §103 rejection of claims 
6, 7, and 10 be withdrawn. 

Claim 17 depends from claim 16 and hence incorporates the features of 
claim 16. As such claim 17 requires "a data retriever for retrieving a time-based 
data stream and a motion data stream at the server, each of the streams comprising 
frames of data; a data stream synchronizer for buffering one of the time-based data 
stream and the motion stream to produce two streams having synchronized frames; 
and a packetizer for packaging synchronized frames of motion data and time-based 
data for use at the client for playback of synchronized motion and time-based data 
to a user." 

Applicants present the arguments in support of claim 18 in regards to 
Katseff 

Durward is cited for its teaching of a method whereby updated positional 
data from a person's head position sensor is mapped and used to determine the 
position of a virtual being defined fro that user. Durward; however,, provides no 
assistance in light of Katseff as to the recited methodology of claim 17. 
Accordingly, a combination of Katseff and Shibata fails to teach or suggest the 
claimed methods. Applicants respectftiUy request that the §103 rejection of claims 
17 be withdrawn. 

Claim 19 recites in part "a method for playing back time-based and motion 
based data that has been synchronized comprising: mapping the motion based data 
to control the movement of virtual figure in a scene displayed at a client; and 
playing back in a synchronization with movement of the virtual figure the time- 
based data." 
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As discussed, Katseff does not disclose nor teach that time-based and 
motion based data streams be synchronized with one another prior to playback at a 
client (workstation). 

Durward is cited for its teaching of a method whereby updated positional 
data from a person's head position sensor is mapped and used to determine the 
position of a virtual being defined fro that user. Durward; however, provides no 
assistance in light of Katseff as to the recited methodology of claim 19, 
Accordingly, a combination of Katseff and Durward fails to teach or suggest the 
claimed methods. Applicants respectfully request that the §103 rejection of claims 
19 be withdrawn. 

Claims 8. 11 

Claims 8, 11 are rejected under 35 U.S.C. §103 as being unpatentable over 
Katseff as applied to claim 1, and in further view of U.S. Patent No. 5,812,791 to 
Wasserman et al (Wasserman). 

Claims 8 and 11 depend from claim 1 and hence incorporate the features of 
claim 1. As such claims 8 and 11 require "...retrieving a time-based data stream 
and a motion data stream at the server, each stream comprising frames of data; 
variably buffering one of the time-based data stream and the motion stream to 
produce two streams having synchronized frames; and using the synchronized 
frames at the client for playback of synchronized motion and time-based data to a 
user." 

Applicants present the arguments in support of claims 2, 4, 12, and 14 in 
regards to Katseff 

Wasserman is cited for its teaching of a method whereby images are 
decompressed for the use of textures, or backgrounds with overlays of moving 
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video on the still images. Wasserman describes a time stamp which is different 
than a descriptor packet. The time stamp in Wasserman allows video to be 
displayed at determined 0,7 intervals. The descriptor packet of the subject 
application provides information that is provided along with the data frames that 
describe content. The content in the descriptor packet does not change, unlike the 
video presentation in Wasserman that is expected to continually change. 

Wasserman provides no assistance in light of Katseff as to the recited 
methodology of claims 8 and 11. Accordingly, a combination of Katseff and 
Wasserman fails to teach or suggest the claimed methods. Applicants respectfiiUy 
request that the §103 rejection of claims 8 and 1 1 be withdrawn. 

Claim 15 

Claim 15 is rejected under 35 U.S.C. §103 as being unpatentable over 
Katseff and Shibata as applied to claim 14, and in further view of Wasserman. 

Claim 15 depends from claim 14 and hence incorporates the features of 
claim 14. As such claims 15 requires "packaging synchronized frames of data 
where each frame includes one or more channels of data in a system in which 
synchronized frames are transmitted by a server over a network to a client, the 
method comprising: storing a last data value for each channel in each frame 
transmitted over the network; ...and packaging and transmitting over the network 
only data for channels having changed data values." 

Applicants present the arguments made in support of claim 14 in regards to 
Katseff 

Wasserman provides no assistance in light of Katseff and Shibata as to the 
recited methodology of claim 15. Accordingly, a combination of Katseff, Shibata, 
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and Wasserman fails to teach or suggest the claimed methods. Applicants 
respectfully request that the §103 rejection of claims 15 be withdrawn. 
Claim 20 

Claim 20 is rejected under 35 U.S.C. §103 as being unpatentable over 
Katseff and Durward as applied to claims 10 and 17 above, and in further view of 
Baumgartner. Examiner points out that claim 20 incorporates substantially similar 
subject matter as claimed in claims 1, 10, 16, and 17. Claim 20 is rejected by the 
same arguments presented in rejecting claims 1, 10, 16, and 17. 

Applicants reassert the arguments presented in support of claims 1, 10, 16, 
and 17 in traversing Examiner's rejection of claim 20. Applicants respectfully 
request that the §103 rejection of claims 20 be withdrawn. 



lee^hayes pec so»*324*82S6 



23 



1127021034 G:\MSl-l\W95uscl\MSI-J09SUSCl.M0I verSJoe 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 



CONCLUSION 

All pending claims 1-20 are in condition for allowance. Applicant 
respectfully requests reconsideration and prompt issuance of the subject 
application. If any issues remain that prevent issuance of this application, the 
Examiner is urged to contact the undersigned attomey before issuing a subsequent • 
Action. 



REMARKS 

Claims 1-20 remain in the application. Applicants respectfully request 
consideration of these claims and issuance of the subject application. 



Respectfully Submitted, 




By: 



^ Emmanuel A. Rivera 
Reg. No. 45,760 
(509) 324-9256 ext. 245 
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MARKED UP VERSION OF PENDING CLAIMS UNDER 37 C.F.IL S 

L121(C)(l)(ii); 

Amend claims 1, 3, and 20 as follows and in accordance with 37 C.F.R. § 
L121(c)(l)(ii), by which the Applicant submits the following marked up version 
only for claims being changed by the current amendment, wherein the markings 
are shown by brackets (for deleted matter) and/or underlining (for added matter): 

1, (Once Amended) A method of synchronizing asynchronous time- 
based and motion data in a system in which the time-based data and the motion 
data are transmitted by a server over a network to a client, the method comprising: 

retrieving a time-based data stream and a motion data stream at the server, 
each stream comprising frames of data; 

variably buffering one of the time-based data stream and the motion data 
stream to produce two streams having synchronized frames; and 

using the synchronized frames at the client for playback of synchronized 
motion and time-based data to a user. 

3. (Once Amended) The method of claim 1 further including 
calculating a difference between delays for the motion data stream and the time- 
based data stream through the server to determine an amount of variable buffering 
for a faster of the two streams. 

20. (Once Amended) A method of synchronizing asynchronous motion 
and audio data in a system in which the motion and the audio data are transmitted 
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by a server computer to one or more clients, the clients providing a real time output 
of synchronized motion and audio data, the method comprising: 

retrieving an audio stream including voice data and a motion data stream 
including one or more motion data channels at the server, each stream[s] including 
frames of data; 

calculating a delay through the server for a frame of data on each of the 
streams; 

calculating a difference between the delay for the audio stream and the 
motion data stream to determine which of the two streams is faster; 

variably buffering a faster of the streams to synchronize the audio stream 
and the motion data stream resulting in two output streams having synchronized 
data frames; 

packaging the synchronized data frames; 

multicasting the synchronized data frames to one or more clients over a 
network; 

at each client computer, using the synchronized data frames for 
synchronous playback of the audio and motion data for display to a user. 
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